Tracking a Conductor’s Baton
نویسنده
چکیده
A system to track an uninstrumented conductor’s baton by computer vision techniques is developed. An initial seek mode locates a baton in an image frame without prior knowledge; a subsequent track mode uses temporal information to cope with motion blur and noise. The seek mode utilises the characteristic form of detected edges to guide a maximal intensity trace. The track mode enhances this technique by dovetailing with optical flow to give robust tracking, even with considerable motion blur and poor quality images.
منابع مشابه
Conducting Audio Files via Computer Vision
This paper presents a system to control the playback of audio files by means of the standard classical conducting technique. Computer vision techniques are developed to track a conductor’s baton, and the gesture is subsequently analysed. Audio parameters are extracted from the sound-file and are further processed for audio beat tracking. The sound-file playback speed is adjusted in order to bri...
متن کاملThe BatonTracker User Guide Version: 3.3
The BatonTracker is implemented as a block for EyesWeb [3] for tracking an ordinary “uninstrumented” conductor’s baton by means of video camera input. Output is given in the form of a stream of baton tip coordinates suitable for passing directly to the associated BeatPattern [7] block. These two blocks can be used in EyesWeb to conduct audio files [9] in conjunction with the Mixxx [1, 2] digita...
متن کاملMusical Analysis of Conducting Gestures Using Methods from Computer Vision
We present technical interpretations of a noted conductor’s gestures. These were enabled by Computer Vision techniques that tracked the position of the conductor’s right hand from a video sequence. The output of the hand tracking system, when combined with beat and tempo data from the audio signal, provides many possibilities for analyzing the conductor’s gestures and expressive techniques. We ...
متن کاملRapid Prototyping of Mobile Input Devices Using Wireless Sensor Nodes
Many options exist for prototyping software-based human-computer interfaces, but there are few comparable technologies that allows application developers to create ad-hoc hardware interfaces with corresponding ease and flexibility. In this paper, we present a system for rapidly constructing low cost prototypes of mobile input devices by leveraging wireless sensor nodes. We demonstrate two proof...
متن کاملOptical Tracking for Music and Dance Performance
This paper describes three different types of real-time optical tracking systems developed at the MIT Media Laboratory for use as expressive human-computer interfaces in music, dance, and interactive multimedia performances. Two of these, a multimodal conducing baton and a scanning laser rangefinder, are essentially hardware-based, while the third is a computer vision system that can identify a...
متن کامل